
3 plus sign (■»■) inskJe mis box -» [ y | 



PTO/SB/06A (OB-00) 
Approved for use through 10/31/2002 0MB 0651 -0031 
U.S. Patenl an<S TrBdemark Office: U.S. DEPARTMENT OF COMMERCE 
^ garwoflt Reduotfon Act of 1995. no perso ns are mauired to res pond to a c ollaction o f intofmation ynisss it contains a valid OM B control number. 



Substitute for fonm I449A/PTO 



INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary} 



Sheet 



1 



of 



4 



Compiete if Known 



Application Number 



Filing Date 



First Named inventor 



Group Art Unit 



Examiner Nams 



Attorney Docket Number 



09/916,249 



July 30. 2001 



Jeffrey Mark Sisktnd 



Not Yet Assigned 



Not Yet Assigned 



NECI1092 



U.S. PATENT DOCUMENTS 


Exarrtrtei 
Injtf3l$* 


Cite 
No.' 


U.S. Patent Document 


of Cited Document 


Data of Publication or 
Cited Document 
MM-DO-YYYY 


PaoA9. Cdumns, Lines. 

Whe/e Retsvani 
Passapes or ftdevanl 
Flqures Appear 


^ Kind Code* 
Numtier / * 
{ifknorfft) 






































































RECEIVhD 




























JUN 1 4 200^ 










































TbuIiiiuIuuv Ceiiibi 210C 















































































































































FOREIGN PATENT DOCUMENTS 


EKaminer 
Initials' 


Cite 
No.' 


Foreign Patent Document 


Name of Patentee or 
Applicant of Cited Document 


Dale of Publication of 

Cited Document 
— MM-OO-VWy — 


Pages, Cotumrw, Unes. 

WherQ Relev^m 
Possagoo or Rel«vant 
— - ~ FfqL(f«g ADOeer 




Kind Code* 

Office' Number* li^k/toM} 























































































































































































Examiner 




Date 




Signature 




Considered 





+ 



•EXAMINER: Initial if reference considered, whether or not citation is In confomiance with MPEP 609. Draw tine through citation if not In conformancB and not 
considered. Include copy of this fomi with next communication Co app'icant 

' Unique dtalion designation number. ^ See attached Kinds of U.S. Patent Documents. ^ Enter Office that issued the docurrtent, by the two-letter 
code {WlPO Standard ST.3). "* For Japanese patent documents, the indication of the year of the reign of the Emperor must precede the sarral 
number of the patent document. ^ Kind of document by the appropriate symbols as indicated on the documeni under WlPO Standard ST- 16 if 
possible. '^Appgcant is to piece a check maric here cf English language Translation is ettached. 

Burden Hour Statement: This form is estimated to take 2.0 hours to complete. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of time you are required to complete this fomi should be sent lo the Chief Information Officer. U. S. Patent and Tradomar^c Oflicft, Washington. DC Z0231. 
DO NOT SEND FEES OR COMPLETED FORI\AS TO THIS ADDRESS, SEND TO: Assistant Commissioner for Patents, Washington. DC 20231. 




se type a plus sign (*) inside ttiis box j y j 



PTo/sB/oee (Od-oo) 

Approved for use mrough 10/31/2002. OMB 0651-0031 
U. S. Patent and Tradefnark Office: U.S. OEPARTMEi^fT OF COMMERCE 
er tha Papofwortt Redudion Act of t995, no persons are required to respond to a coltection of Infofmation unless It contains a valid OMB oonifpl number. 



+ 



Sututiluts for form 1449B/PT0 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(us9 as many sheets as necessary) 



Sheet 



of 4 



ComptetB H Known 



Application Number 



Filing Date 



First Named Inventor 



Group Art Unit 



Examiner Name 



Attorney Docket Number (s| £C1 1 092 



09/916,249 



July 30. 2001 



Jeffrey Mark Siskind H ^ I VE D 
Not Yet Assigr^ed * 



Not Yet Assigned 



m 1 



2004 



Tecnnoiogy C enter ?inn 



OTHER PRIOR ART - NON PATENT LITERATURE DOCUMENTS 


Examiner 
Inilials' 


Cite 
No.' 


Induda name of the author (in CAPITAL LETTERS), tide of tha article (when approprfate). title of the 
ilem (book, nvagszlne, journal, sarol, symposium, catalog, etc.), date, paga(5), volume-issue number(s}. 
publisher, dty and/or country whore published. 








AA 


Abe. N. et a!., "A Plot Understanding System on Reference to Both Image and Language.* Proceedings of the 
Seventh International Joint Conference on Artificial Intelligence, Vancouver. Canada, pp. 77-64, August 1981. 








AB 


Abe, N, et al.. "A Learning of Object StoiCtures by Verbalism." OGLING 82. pp. 1-6. 1982. 








AC 


Adier, M.R., "Computer Interpretation of Peanuts Cartoons," 5th International Joint Conference on Artificial 
Intelligence. Cambridge, MA, pp.608, August 1977. 








AD 


Allen, J.F., "Maintaining Knowledge About Temporal Intervals," Communications of the ACM, Volume 26. 
Numberll, pp. 832-843, November 1983. 








AE 


Slum, M. el al., "A Stability Test for Configurations of Blocks/ Artificial Intelligence Memo No. 188, 
Massachusetts Institute of Technology, Febojary 1970. 








AF 


Bobick, A.F. et al., "Action Recognition Using Probabilistic Parsing." Proceedings of the IEEE Computer 
Sodeiy Conference on Computer Vision and Pattern Recognition, pp. 196-202, June 1998. 








AG 


Borchardt. G.C., "A Computer Model for the Representation and Identification of Physical Events," Masters 
Thesis, University of Kansas, May 1984. 








AH 


Borchardt, G,C., "Events Calculus." Proceedings of the Ninth International Joint Conference on Artificial 
Inteltigence. pp. 524-527, August 1985. 




j 




Al 


Brand, M. et al., "Sensible Scenes: Visual Understanding of Complex Structures Through Causal Analysis," 
Proceedings of the Eleventh National Conference on Artificial Intelligence, pp. 588-593. 1993. 








AJ 


Fahlman. S.E., "A Planning System for Robot Construction Tasks," Artificial Intelligence. Voiunne 5, Number l . 
pp. M9, 1974. 








AK 


Krifka, M., Thematic Relations as Links Between Nominal Reference and Temporal Constitution." Lexical 
Matters, Sag, I.A. (eds.), pp.29-53, 1992. 





Examiner 
Signature 



Dale 

Considered 



^EXAMINER: Initial if reference considered, whether or not citation is in ocnformance with MPEP 609. Draw line through citation if not in Gonformance and not 
considered. Indude copy of this form with noxt communication to applicanL 

' Linique citation designation number. } Applicant }s to place a check mark here if English language Translation is attached. 

Burden Hour Statement: This form is estimated to take 2.0 hours to complete. Tims will vary depending upon the needs of the individual case. Any comments on 
the arrwont of time you are required to complete this farm should be sent to the Chief Information Officer. U. S. Patent and Tradoinarlt Office, Washington. DC 20231 . 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, vvashington. DC 20231. 




a plus sign (+) inside this box . 



H- 



PTO/SB/08B (OS^) 
Approved for use thnsugh 10/31/2002. OMB 0651-0031 
U. S. Patent and Trademartc Office: U.S. DEPARTMENT OF COMMERCE 
Papetwoik Reduction Act of 1995. no persons ara required to fespcnd to a collection of jnfgrmatjon unless II contains a valid OMB control number. 



Subsliluta for form 1449B/PTO 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessaty) 



Sheet 



of 4 



Complete if Known 



Application Number 



Filing Date 



First Named Inventor 



Group Aft Unit 



Examiner Name 



Allofney Docket Number NEC 1 1092 



09/916.249 



July 30, 2001 
Jeffrey Mark Siskind M |\/Pn 
Not Yet Assigned ^^'y^tqi V UL-/ 



Not Yet Assigned 



OTHER PRIOR ART - NON PATENT LITERATURE DOCUMENTS 


Examiner 
Initials' 


Cite 
NO.^ 


tnduda name of the author (in CAPITAL LETTERS), UUe of the article <v/hen appropriate), title of the 
item (book, magszlna. journal, serfal. symposium, catalog, etc.). date, page(s), votume4ssuo numt>er<s), 
publisher, 6ty and/or country whore published. 






•A 


AL 


Mann, R. et al.» 'Towards the Computational Perception on Action," Proceedings of the IEEE Computer 
Society Conference on Computer Vision and Pattern Recognition, Santa Barbara. CA, pp. 794-799, 1996. 








AM 


Mann. R. et al., The Computational Perception of Scene Dynamics.'* Computer Vision and Image 
Understanding, Volume 65. Number 2, pp. 11^-128, February 1997. 








AN 


McCarthy, J., 'Circumscription - A Form of Non-Monotonic Reasoning." Artificial Intelligence. Volume 13, pp. 
27-39, 1980. 








AO 


Okada, N., "SUPP: Understanding Moving Picture Patterns Based on Linguistic Knowledge/' Proceedings of 
the Sixth International Joint Conference on Artificial Intelligence. Tokyo, Japan, pp. 690-692. August 1979. 








AP 


Regier, T P., The Acquisition of Lexical Seminatics for Spatial Ternre: A Connectionist Model of Perceptual 
Categorization," Ph.D. Thesis, University of California, Berkeley, 1992. 








AQ 


Shoham, Y.. Temporal Logics in Al: Semantical and Ontological Considerations," Artificial Intelligence, 
Volume 33. pp. 89-104, 1987. 








AR 


Siskind, J.M., "Naive Physics, Event Perception, Lexical Semanics. and Language Acquisition,** Ph.D. Thesis, 
Massachusetts Institute of Technology, 1992. 








AS 


Siskind, J.M., "Axiomatic Support for Event Perception." Proceedings of the AAAI-94 Workshop on the 
Integration of Natural Language and Vision Processing, Seattle, WA pp. 153-160, August 1994. 








AT 


Siskind. J,M., "Grounding Language in Perception," Artificial Intelligence Review, Volume 8. pp. 371-391, 
December 1994. 








AU 


Siskind, J.M., "Unsupervised Learning of Visually-Observed Events." AAAI Fall Symposium Series on 
Learning Complex Behaviors in Adaptive Intelligent Systems, pp. 82-83, 1996. 








AV 


siskind, J.M., "Visual Event Perception", Proceedings of the 9th NEC Research Symposium, Princeton, NJ, 
March 1999, 





2004 

/enter 2100 





Exanriiner 
Signature 




Date 

Considered 





'EXAMINER: Initial il reference considered, whether or not citation is in conformance with MPEP €09, Draw line lhrou9h citation if not in conforniaricQ and not 
considered. Include copy of this form wth next communtcation to appftcanL 

* l/nlque citation desigrtation number. ' Applicant is to ptaoo a check marft here if English (angua^d Transfation is attached. 

Burd3R Hour Staternsnt: This form ts estimated to take 2.0 hours to conplele. Time will vary depending upon the needs of the individual case. Any comments on 
the amount of fima you are required to compteie this fbmn should be sant to the Chief information OfTtcer, U. S. Patent and Trademarfc Office, Washington. DC 20231 . 
DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Assistant Commissioner for Patents, Washington. DC 20231. 



Ees! Available Cod^ 




+ 



a plus sign t+) Inskla this box 
Paperworit ReducUon Act of 1995. no persons are reouired 



PTO^Se/08B (08-00) 
Approved for use through l0/3 V2002. OMB 0651-0031 
U S Patent and TrademaiK OHicc: U.S. DEPARTMENT OF COMMERCE 
to fBSOond to e collection ofinfomation unlpss it contains a valid OMB control number. 



Substitute for farm 1449B/PTO 

INFORMATION DISCLOSURE 
STATEMENT BY APPLICANT 

(use as many sheets as necessary) 



Sheet I 4 



of I 4 



Complete ff Known 



Appltcation Number 



Date 



First Named Inventor 



Group Art Unit 



Examiner Name 



Attorney Docket Number 



09/916.249 



July 30. 2001 



Jeffrey Mark Siski 



Not Yet Assigned 



Not Yet Assigned 



NECI1092 



/ED 



JUNJJ/2004 

ter2100 



Examiner 
Initials' 


Cite 
No.' 


Indude name of the author (in CAPITAL LETTERS), tide of the article (when appropriate), ^^^or^f 
item Crmagazlnejoumal! serial, symposium, catalog, etc.). date page (s), volume-issue numbers). 






AW 


SlsWnd. J.M.. Visual Event Classification via Force Dynamics; Proceedings of Ihe Seventeenth NaUonal 
Conference on Artificial Inlelligence. August 2000. 






AX 


Siskind. J-M. et al.. "A Maximom-Ukelihood Approa* ^^"t Cla^^^^^^ Proceed.ngs of the 4th 
European Conference on Computer Vision. Cambridge. UK, pp. 347-360. Apnl 1 996. 






AY 


Stamer, T.E., "Visual Recognition of American Sign Language Using Hidden Markov Models," Masters 
Thesis, Massachusetts Institute of Technology, February 1995. 






A2 


Talmy. L.. "Force Dynamics in Language and Cogniton." Cognitive Science, Volume 12, pp. 4a.nw, laoo. 






BA 


Thibadeau,R.."Artilicial Perception of Actions," Cognitive Science. Volume 10. Number 2. pp. 117-149, 1986. 






8B 


Tsuji. S, et al.. "Understanding a Simple Cartoon Film by a (^f^^'fj^^iaion System; of the Srt, 
International Joint Conference on Artificial Intelligence. Cambridge MA, pp. 609-610. August 1977. 






BC 


TsujI, S. et al., -Three Dimensional Movement Analysis of Dynamic "'^ 
inlerliational Joint Conference on Artificial Intelligence. Tokyo, Japan, pp. 896-901 . August 1979. 






BD 


Tsuil, S. et a!.. "Tracking and Segmentation of Moving Objects in '^'"arnic Line Images," IEEE Transactions 
on Pattern Analysis and Machine Intelligence. Volume 2. Number6. pp. 516-522. 1980. 




4 


BE 


Waltz DL -Toward a Detailed Modelof Processing for Language Describing the Physical World 
Pw^U^ ofTe Seventh International Joint Conference on Arfincial intelligence. Vancouver. Canada, pp. 
1-6. August 1981. 






BF 


waltz. D.L.. "Visual Analog Representations for Natural Language Understanding^^' P;oc«f 'ogs of the Sixth 
International Joint Conference on Artificial Intelligence. Tokyo. Japan, pp. 926-934, August ia/». 




^.1 


I BG 


Yamato. J. et al.. "Recognizing Human Action in Time-Sequential Images "sing Hidden Markov M<^el." 
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 379-385, 1992. 





Considered 



..... - ■ ^th kAPPO fiftQ nraw line throuoh citation if not in conformance and not 

•EXAMINER: initialif reference considered, whether or not otation is tnconfomianco with MPEP 609. Drawiinouiiu y. 

considered. Include copy of this form with next communication to applicant 

^ Unique citation designation number. ^ Applicant is to place a checK martt here if Engtlsh language Translation is attached. 
3.,enH.ur3tatement:Thisfom.ise..matedtotaKea.Ohourstocomp.^^^ 

the amount of time yoo are required to complete this fom> should be sent to the Chiel nformajon ^f^^"; "^f-j^ p^^^^ qC 20231. 

dS NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Ast^lant Comm.ss.onar for Patents, Washington. UL, /u^j 



